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Abstract. This study addresses the matter of reflexive control of the 
emotional states by means of Reflexive Game Theory (RGT) . It is shown 
how to build a bridge between RGT and emotions. For this purpose the 
Pleasure-Arousal-Dominance (PAD) model is adopted. The major ad- 
vantages of RGT are its ability to predict human behavior and unfold 
the entire spectra of reflexion in the human mind. On the other hand, 
PAD provides ultimate approach to model emotions. It is illustrated that 
emotions are reflexive processes and, consequently, RGT fused with PAD 
model is natural solution to model emotional interactions between peo- 
ple. The fusion of RGT and PAD, called Emotional Reflexive Games 
(ERG), inherits the key features of both components. Using ERG, we 
show how reflexive control can be successfully applied to model human 
emotional states. Up to date, EGR is a unique methodology capable of 
modeling human reflexive processes and emotional aspects simultane- 
ously. 
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1 Introduction 

The theory of personal constructs proposed by Kelly [TD] in 1955 initiated the 
strong debates. This theory suggests that each person has one's own unique sys- 
tem of dichotomous (bipolar) constructs, which serve as special axes for "pro- 
jecting" self and other persons. Most of the constructs may be mapped onto the 
scale of "good-bad" . Kelly flO; developed the experimental approach for essem- 
beling the list of personal constructs and a list of one's images of other people. 
The poles, the constructs are represented with, are of negative ("bad") and pos- 
itive ("good") types. Hereafter, the theory proposed by Kelly will be referred 
as Theory of Bipolar Constructs. According to Kelly, these poles should be cho- 
sen with equal probability. However the subsequent psychological experiments 
proved this suggestion wrong. 

In earlier experiments, it was shown by Benjafield and Adams- Webber [5], 
Adams- Webber [T], Benjafield and Green [B], Shalit [2H], Osgood and Richards 
[25] and Osgood [SJ that under great variety of experimental conditions the 
positive pole is chosen with the frequency 0.62. 
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The persistent appearance of the frequency 0.62 resulted in two ways. First, 
the reasonable question "What is the true value of the probability this frequency 
represents?". Second, it was suggested by Lefebvre |Ilj(p. 291) that 

"... human cognition has a special mechanism for modeling self and 
others. It works as a universal 'inner computer' and creates the core 
of the images that later are 'dressed' and 'colored' with nuances. The 
constant 0.62 is a characteritic of this 'computer'." 

It was determined by Lefebvre that the true value of the frequency 0.62 is 
probability 0.618..., which is inverted Golden Ratio (j) {(j) = 1.618...) [UlIS]. 

Therefore, the Golden Ratio, as being a characteristic of the 'inner computer', 
is related to the Implicit Primordial Knowledge (IPK) [31] . 

Now we return to the Theory of Bipolar Constructs. It had strong impact on 
subsequently conducted psychological researches. The research about the emo- 
tions was not an exception. 

The semantic differential approach originally proposed by Osgood et al. 
considers three dimensions to characterize the person's personality. These di- 
mensions are Evalution, Activity and Potency. 

This approach was further tested from the point of view of emotions. Russel 
and Mehrabian [30] proved in their study that the entire spectra of emotions 
can be described by the 3-dimensional space spanned by Pleasure (Evaluation), 
Arousal (Activity) and Domination (Potency) axes. For every dimension, the 
lower and upper bounds (ends) are recognized as negative and positive poles, 
respectively. Gonsequently, the negative pole can be described by negative ad- 
jectives, and positive one by positive adjectives. 

It was shown by Russel and Mehrabian [3D] that these three dimensions are 
not only necessary dimensions for an adequate description of emotions, but they 
are also sufficient to define all the various emotional states. In other words, 
the Emotional state can be considered as a function of Pleasure, Arousal and 
Dominance. On the basis of this study, Mehrabian j5H proposed Pleasure- 
Arousal-Dominance (PAD) model of Emotional Scales. The emotional states 
defined as combinations of ends from various dimensions are presented in Fig. [T] 

In this study, we discuss the matter of how the PAD model can be used 
in Reflexive Game Theory (RGT) [l6] [T7] to emotionally color the interactions 
between people and humans and robots. 

2 Building the Bridge between PAD Model and RGT 

2.1 Representation of PAD model in the space of binary 3D vectors 

The most important issue to fuse RGT inference and PAD Emotional Scale is 
to build the bridge between two approaches. 

By definition, PAD model is spanned by three dimensions. The value of 
each component continuously ranges from -1 to 1. The notation in the PAD 
model space presented in Fig. fllare as follows: 1) pair +P vs —P corresponds 
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to Pleasure (positive pole: value 1) vs Displeasure (negative pole: value -1); 2) 
pair +A vs —A corresponds to Arousal (positive pole: value 1) vs Non-arousal 
(negative pole: value -1); and 3) pair +D vs —D corresponds to Dominance 
(positive pole: value 1) vs Submissiveness (negative pole: value -1). 

Accodring to Mehrabian [52] , "pleasure vs displeasure" distinguishes the pos- 
itive vs negative emotional states, "arousal vs non-arousal" refers to combination 
of physical activity and mental alertness, and "dominance vs submissiveness" is 
defined in terms of control vs lack of control [12] . 

Though, PAD model operates with continous values, i.e., for example, 
curious is coded as (0.22,0.62,-0.01). Mehrabian [25] defines 8 basic states, 
which are all possible combinations of high vs low pleasure {+P vs —P), high 
vs low arousal {+A vs —A), and high vs low dominance {+D vs —D). In other 
words, there 8 basic states are all possiblecombinations of the poles. In total, 
there are 6 poles - two for each of three scales. Therefore, there are 2'^ = 8 
possible combinations of poles. These states (combinations) are considered as 
extreme states and can be refered as approximations of the intermediate states. 
For instance, intermediate state "angry" (-0.51, 0.59, 0.25) can be approximated 
by extreme state "hostile" {—P,+A,+D). Therefore, only eight extreme states 
can be used to describe the entire variety of intermediate emotional states. 



D (Dominance) 




I) 



Fig. 1. The Pleasure-Arousal-Dominance (PAD) model's space. 



The combinations of poles in the PAD space can be presented as 3-dimensional 
binary vectors, where 1 corresponds to positive pole (1 in PAD notation) and 
refers to negative pole (-1 in PAD notation). Therefore, emotional states, which 
are combinations of different poles of various dimensions, can be represented as 
follows: for instance, emotional state Hostile (-P,+A,+D) or (-1,1,1) can be sub- 
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Table 1. Disjunction operation 
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Table 2. Conjunction operation 
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stituted for {0, 1, 1}, while Relaxed (+P,-A,+D) or (1,-1,1) can be represented 
as {1, 0, 1} in the rescaled coordinates. 

The complete set of emotional states represented as binary vectors is 
Docile (+P, -A, -D) is coded as {1, 0, 0}; 
Anxious {—P, +A, —D) is coded as {0, 1,0}; 
Disdainful (— P, —A, is coded as {0, 0, 1}; 
Hostile (-P, +A, +D) is coded as {0, 1, 1}; 
Dependent {+P,+A,—D) is coded as {1,1,0}; 
Relaxed {+P, —A, +D) is coded as {1, 0, 1}; 
Exuberant (+P, +A, +D) is coded as {1, 1, 1}; 
Bored (-P, -A, -D) is coded as {0, 0, 0}. 

Among eight basic states, there are three special emotional states Docile 
(+P,-A,-D) = {1,0,0}), Anxious {-P,+A,-D) = {0,1,0}) and Disdainful 
{—P,—A,-\-D) = {0,0,1}). These three states are the basis of the 3d binary 
space. Thus, any other five emotional states can be considered as disjunction 
(notations OR/U/+) of these three basis vectors (emotional states). The binary 
disjunction operation is presented in Table [T] 

For example, emotional state Dependent (+P, +A, —D) is disjunction of 
basis states Docile {+P,—A,—D) and Anxious {—P,+A,—D): Docile OR 
Anxious = {+P,-A,-D) U {-P,+A,-D) = {1, 0, 0} U {0, 1, 0} = {1,1,0} 
= (+P, +A, -D) = Dependent. 
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2.2 Formalism of the Reflexive Game Theory 

In this section, we present the basics of the Reflexive Game Theory (RGT). In the 
RGT, it is considered that behavior of each subject in the group is determined 
by reflexive function which is function of subjects' mutual influences |16[ I17| 

MM- 

<P = <P{ai,...,a,,...,an), (1) 

where n is a total number of subjects in the group; aj, for any j = 1, n; j ^ i, 
influence of subject aj on subject at. 

Then the choice of subject is defined by decision equation jTHj I17j: 

a,; = ^(ai, flj, a„), (2) 

The RGT uses Boolean algebra of alternatives for calculus. There three op- 
erations defined in Boolean algebra. These are unary negation operation and 
binary conjunction and disjunction operations. The disjuction and conjunction 
operations are defined in Tables [T] and [2j respectively. 

In this study, we employ Boolean algebra containing eight 3d binary vectors: 
{1, 0, 0}, {0, 1, 0}, {0, 0, 1}, {1, 1, 0}, {1, 0, 1}, {0, 1, 1}, {0, 0, 0}, and {1, 1, 1}. The 
element of Boolean algebra code particular infiuences. Each element of Boolean 
algebra is referred as alternative. 

The RGT deals with groups of individuals. Any group is represented with 
relationship graph. Any group, whose graph is decomposable!^ can be represented 
as polynomial P. 

The relationships in the group are indicated with ribs. The solid-line ribs 
represent alliance relationship. The dashed-line ribs correspond to conflict rela- 
tionship. In algebraic form, conjunction or multiplication operations represent 
alliance, while disjunction or summation operations correspond to conflict rela- 
tionship. The idea behind is as follows. Two subjects being in alliance can find 
the compromise or a common influence, therefore their interaction can be char- 
acterized as conjunction of their influences. At the same time, two conflicting 
subjects will never reach a compromise and their interaction should include both 
influences. Therefore disjunction operation corresponds to the conflict relation- 
ship. 

Considerring the disjunction and conjunction operations, the group, in which 
subjects a and b are in conflict with each other and in alliance with subject c, is 
represented as (a -|- b)c polynomial. Relationship graph is presented in Fig. [2j 

c 



a I ^ 5 

Fig. 2. Relationship graph for three subject a, b and c. 
^ See [161 1171 118j for detailed discussion about graph decomposition. 
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Then on the basis of polynomial P, the polynomial stratification tree is con- 
structed (Fig. [3]). 



[a] + [b] 
\ / 

[a + b]-[c] 

\ / 
[ia + b)c] 

Fig. 3. Polynomial stratification tree for polynomial (a + 6)c. 

By omiting the branches of the polynomial stratification tree, the diagonal 
form [TBI [El HSl [m 132] is obtained straight forwardly. Consider the diagonal 
form corresponding to the PST presented in Fig. [3] 

[a] + [b] 
[a + b] .[c] 

[ia + b)c] 

The reflexive function <P is defined by the corresponding diagonal form. Thus, 
reflexive function for subjects a, b and c is 

[a] + [b] 
[a + b] ic] 

<P{a,b,c) = [{a + b)c] 

Therefore, the root of the diagonal form is polynomial P. We define the 
remaining part of the diagonal form as W. Thus, the diagonal form can be 
presented as P^ . 

Accroding to the definition given by Lefebvre |13j , the exponential operation 
P^ is defined by formula 

= P + W , (3) 

where W stands for negation of W (THl fTTl [T5] . 

This operation is used to fold the diagonal form. Therefore, in general case 
reflexive function is defined as 

<P{ai,...,a,,...,an) = P + W , (4) 

Next we fold the diagonal form for three subjects a, b and c: 

([a + 6]+RTM)[c] 

[(a + 6)c] 

l[c] 

[{a + b)c] =(a + 6)c + c. 
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The reflexive function <P for the subjects a, h and c discussed above is then: 
^{a,b,c) = (a + fe)c + c , (5) 
The general form of decision equation for each subject is then 

X = {a + b)c + c , (6) 

where x is any subject variable a, b or c. 

Finally, we briefly present the solution method of the decision equation. Con- 
sider the decision equaition in a form: 

X ^ Ax + Bx , (7) 

where A and B are some sets. 

This form of the decision equation is called canonical form |16l 1171 1321 133) 
of the decision equation. If sets A and B are such that A ^ B, then decision 
equation in canonical form has at least one solution from the interval AD x D B. 



2.3 Merging the RGT and PAD model 

Summarizing the facts about the RGT and PAD model, we highlight that RGT 
has been proven to predict human choices in the groups of people and allows to 
control human behavior by means of particular influences on the target individ- 
uals. Next we note that PAD model provides description of how the emotional 
states of humans can be modelled, meaning that a certain emotional state of a 
particular person can be changed to the desired one. Furthermore, it is straight- 
forward to see that the coding of the PAD emotional states and alternatives of 
Boolean algebra are identical. 

Therefore, it is possible to change the emotional states of the subjects in the 
groups by making influences as elements of the Boolean algebra. In such a case, 
vector {1,0,0}, for example, plays a role of influence towards emotional state 
Docile. 

Besides, we have distinguished three basis emotional states Docile ({1, 0, 0}), 
Anxious ({0,1,0}) and Disdainful ({0,0,1}). The interactions (as defined by 
disjunction and conjunction operations) of these basic emotional states can result 
in derivative emotional states such as Dependent, Relaxed, etc. Before, consid- 
ering the example of PAD application in RGT, we note that reflexive function 
# defines state, which subject is going to switch to. This process goes uncon- 
sciously. We have discussed above the reasons the conjunction and disjunction 
represent alliance and conflict relatioships, respectively. 

Another important issue is that often people directly express their emotions 
in actions. Therefore in such a case, a particular emotional state of a subject can 
be considered as the influence he is making on other subjects. 

Example 1. Subjects a and b are in alliance relationship. Subject a makes in- 
fluence Dependent {1, 1,0}. Subject b makes influence Relaxed {1,0, 1}. Their 
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resultant influence will be {a ■ b) — {1, 1, 0}{1, 0, 1} = {1,0,0} or Docile. Con- 
sequently, the influence of the group, including subjects in alliance with each 
other, on a given subject is considered as conjunction (defining compromise of 
all the subjects in alliance) of the influences of all the subjects' influences. 

Example 2. Subjects a and b are in conflict relationship. Subject a makes 
influence Docile {1, 0, 0}. Subject b makes influence Disdainful {0, 0, 1}. Their 
resultant influence will be {a + b) = {1, 0, 0}{0, 0, 1} = {1,0,1} or Relaxed. 
Therefore, the influence of the group, including subjects in conflict with each 
other, on a given subject is considered as disjunction (defining overall influence 
since compromise is impossible) of the influences of all the subjects' influences. 

Next, we consider an example of reflexive interactions controlling emotional 
states. 



3 Emotionally Colored Reflexive Games: Sample Situation 

Consider a group of four subjects - the director d and his advisors a, b and c. Let 
advisors a,b and c are in alliance with each other and in conflict with director 
d. The graph of such group is presented in Fig. |4j This groups is described by 
polynomial abc + d. 



b 



d 




a 



c 



Fig. 4. Relationship graph of four subjects a, b, c and d. 



The canonical form of decision equation for each subject are: 



a 



c 



b 



(be + d)a + da 
[ac + d)b + db 
{ab + d)c + dc 
d = d + abed 



(8) 
(9) 
(10) 
(11) 



The corresponding solution intervals are 



(6c + d) D a D d 
{ac + d)^bDd 
{ab + d)DeDd 



1 D d D abe 



(12) 
(13) 
(14) 
(15) 
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It is assumed that each subject is in a particular unique emotional state. Let 
director will be in Exuberant emotional state. The advisors a, b and c are in 
Relaxed ({1,0,1}), Docile ({1,0,0}) and Anxious ({0,1,0}) emotional states, 
respectevely. This variety in emotional states refrains director and his advisors 
from reaching a fruitful decision. Understanding this emotional situation, direc- 
tor decides to apply reflexive control on emotional level. Let adivors' influence 
on all the other subjects coincides with their emotional state, while directly is in 
complete control and can decide, which emotional influence to on each particular 
subject. 

Using RGT, we can predict the emotional states of each subject in the group 
after the reflexive emotional interaction: 
for subject a: ({1, 0, 0}{0, 1,0} + d) D a D d ^ a = d; 
for subject b: ({1, 0, 1}{0, 1, 0} + d) D & D d a = d; 
for subject c: ({1, 0, 1}{1, 0, 0} + d) D c {1, 0, 0} + d D c D d; 
for subject d:lDdD {1, 0, 1}{1, 0, 0}{0, 1, 0} ^lDdDO^d = d. 

Therefore, under conditions of such group structure and influences, decision 
of advisors a and b is completely defined by the director's influence. 
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Fig. 5. Interpretation of the Diagonal form levels. 



The entire diagonal form {P + W) represents the state of the subject. In 
Fig. [Hj the diagonal form is marked as Subject. The term W is called a general 
image of the self. On the next level, there are two images of Image 1 ( [a6c] I"' ^''1 ['^l ) 
and Images 2 {[d]). The Images 1 and 2 are images of the self, which general 
image of the self W has. Finally, there are the images [a], [b] and [c] are the 
images of the self, which Image 1 has. 

Following this interpretation of the diagonal form [121 EZ] , we can calculate 
each emotional state in each image. We analyze the structure of reflexion for 
advisor c. His state is ({1,0,0} + d) or {Docile{+P, —A, —D) plus director's 
influence). The emotional state in the Image 1 is Exuberant (1 — {1, 1, 1}), 
because [a6c][°^'^l = [abc] + [abc] = 1. The Image 2 is [d] that means it is en- 
tirely defined by director's influence. Finally, the general images of the self W is 
Exuberant (1 = {1, 1, 1}). 
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In this simple example, we have illustated how the emotional states can 
appear to be the subject for the reflexive control. We call such reflexive control 
to be reflexive emotional control. We have shown how the reflexive emotional 
control can be sucessfuUy implemented by means of the Reflexive Game Theory. 

Besides, the RGT allows to unfold the entire sequence of reflexion in the 
human mind including its emotional aspects. 

4 Discussion 

In the previous sections, we have introduced the bridge between the PAD model 
of emotional states and RGT calculus by coding PAD's emotoinal states in terms 
of RGT's Boolean algebra of alternatives. We also illustrated how the emotional 
states can be the subject of reflexive control and can be successfully managed. 
This is possible, because the variables in the PAD, namely. Pleasure, Arousal, 
Dominance, are proved to be necessary and sufficient variables to control human 
emotions W].- In other words, necessity means that if emotional state is changed 
the value of all three variables is changed accordingly. On the other hand, if the 
values of the variables are changed, the emotional state is also changed. We have 
illustrated how to merge the RGT calculus with proper coding of PAD emotional 
states. Finally, we have provided a simple explanatory example of how reflexive 
emotional control can be applied in action. 

Furthermore, we have not only illustated how to apply RGT to the control 
of subject's emotions, but uncovered the entire cascade of human reflexion as a 
sequence of subconscious reflexion, which allows to trace emotional reflection of 
each reflexive image. This provides us with unique ability to unfold the sophis- 
ticated structure of reflexive decision making process, involving emotions. Up to 
date, there has been no approach, capable of doing such thing, reported. 

The emotional research based on PAD model is transparent and clear. The 
models of robots exhibiting human like emotional behavior using only PAD has 
been successfully illustrated in recent book by Nishida et al. 23 . The ability 
to influence the factors (variables) is the major justiflcation for such approaches 
and for the application of the RGT. Yet, it is just a "mechanical" part of the 
highly sophisticated matter of human emotions. 

The present study introduces the brand new approach to modeling of human 
emotional behavior. We call this new breed of RGT application to be emotional 
Reflexive Games (cRG). At present RGT fused with PAD model is the unique 
approach allowing to explore the entire diversity of human emotional reflexion 
and model reflexive interaction taming emotions. This fusion is automatically 
formalized in algorithms and can be easily applied for further developing emo- 
tional robots. 

Since the proposed mechanism has no heavy negative impact on human psy- 
chologycal state, robots should be enabled to deal with such approach in order 
to provide human subjects with stress free psychological friendly environments 
for decision making. 
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Next, we discuss more complex question regarding emotion and reveal the 
facts of why the Reflexive Game Theory is the natural approach to model emo- 
tions. 

We start from trying to answer the question - what are the emotions them- 
selves? 

According to Ekman [V., emotions shoud be regarded as highly automat- 
ics processing algorithms responsible for our everyday life survival. Being entire 
unconscious (automatic) regulators of the human body's physiology, emotions 
bring the instantenous solutions of how to act in front of rapidly approaching 
possible threat. This instantenous activity is possible due to unconscious pro- 
cessing algorithms, which have been characterized by Lewicki et al. [20l [21] as 
highly non-linear by nature and extremely fast by performance. 

Therefore, emotions are fast processors of the information coming apart from 
environment. Usually, the emotions are characterized by some physiological pat- 
terns of body activity on the one hand, and external expression by face mimic or 
gestures on the other hand. From this point of view, the fact that the reproduc- 
tion by the self of physical part of emotional pattern, i.e., just making an angry 
face can elicit the anger as emotional state itself [SJ [12] , is completely scientif- 
ically unexpected phenomenon. Yet this seems to be widely known by writers. 
For instance, Edgar Allan Poe, in his story "The Purloined Letter", describes 
how one character is attemping to understand the intensity of emotional expe- 
rience of another character by self-mimicing (or imitating) facial expressions of 
another one. 

This imitation is interesting from the point of view of reflexive processes. 
Vladimir Lefebvre in his book "Structure of Awareness" [12] writes: 

"Reflexion in traditional phylosophical psychological sense is ability 
to place one's mind into external position of 'observer', 'researcher' or 
'controler' of one's own body, actions and thoughts. We extend such 
understanding of reflexion and will consider that reflexion is ability to 
place one's mind into external position to another 'character', his actions 
and thoughts." . 

From this point of view, the self-mimicing is reflexive process. Thus, it is pos- 
sible to elicit and understand the emotions of others by reflexion. Ekman et al. 
[9](p. 1210) suggested that this is possible due to "... direct connections between 
motor cortex and hypothalamus that traslates between emotion-prototypic ex- 
pression in the face and the emoition-specific pattering in the autonomic nervous 
system" . 

On the other hand, the reflexive processes are at the core of the RGT. There- 
fore RGT is natural approach to model emotions. 

Continuing the line of logic that emotions can be elicited by self reproducing 
patterns of motor activity accompanying expression of emotions, we suggest the 
not only facial expressions, but also other motor patterns such as gestures can 
elicit the corresponding emotion. 

Consequently wide variaty of motor actions can cause some emotional states 
to emerge. On the other hands, other actions, not related to the physical activity, 



12 Sergey Tarasenko 



can result in particular emotions. Therefore, it is possible to control human 
emotions not directly, but making people to perform particular actions. From 
this perspetive, PAD model can serve as a measuring device of how actions 
influence emotions. 

However, since the emotions are automatic processing algorithms, which take 
their input apart from environment, the environment itself is natural medium to 
influence on emotions. How this can be applied in interior of shops to provide a 
customer with delightful emotional state is described by Soriano et al. [29.. 

Therefore, the continously on-going decision making process of selecting and 
implementing action etc. is always accomapanied by emotional process, which 
characterize each action from the emotional perspective. 

We consider that the material presented in this study has essential influence 
on the brand new Reflexive Game Theory. Furthermore, the results presented 
extend widely recognized field of Affective Compiting [37] with new powerful 
computational paradigm, which is ready to be applied in robots. 
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